MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS -1963 -A 


AD- A 187  492 


APPROVED  FOR  PUBLIC  RElE; 

DISTRIBUTION  UMUWIFED 


UIK  ALE  Copy  - 


MASSACHUSETTS  INSTITUTE  OF  TECHNOLOGY 


VLSI  PUBLICATIONS 


VLSI  Memo  No.  87-368 
March  1987 


SCHEDULING  JOB  SHOPS  WITH  DELAYS 


Sheldon  X.  C.  Lou,  Garrett  Van  Ry2in,  and  Stanley  B.  Gershwin 


Abstract 


"*  In  this  paper,  the  presence  of  delay  in  a  job  shop  is  addressed.  Ve  show  that 
delay  is  an  important  consideration  in  many  manufacturing  systems  that  are 
modeled  as  continuous  flow  processes.  A  scheduling  policy  for  a  job  shop  with 
delays  is  then  derived  using  theoretical  arguments  and  heuristics. 


Accession  For 

NT IS  GRA&I 

DTIC  TAB 

£ 

Unannounced 
Justification _ 

□ 

By - 

Distribution/ 


Availability  Codes 
[Avail  and/or 
Special 


DTIC. 

e,lscte 

NOV  1  8 1987 


CA 


100 


Microsystems 
Research  Center 
Room  39-321 


Massachusetts 
Institute 
of  Technology 


Cambridge 

Massachusetts 

02139 


Telephone 
1617)  253-8138 


Acknovledgemen  t  s 

Published  in  Proceedings,  1987  IEEE  International  Conference  on  Robotics  and 
Automation,  Raleigh,  NC,  March  3l  -April  2,  1987.  This  work  was  supported  in 
part  by  tKe  Defense  Advanced  Research  Projects  Agency  under  contract  no. 
N00014-85-K-02 1 3 . 


Author  Information 

Laboratory  for  Information  and  Decision  Systems,  MIT,  Cambridge,  MA  02139, 
Lou:  Room  35-431,  (617)  253-3640;  Van  Ryzin,  c/o  Gershvin;  Gershvin:  Room  35- 
433,  (617)  253-2149. 


Copyright  (c)  1987,  MIT.  Memos  in  this  series  are  for  use  inside  MIT  and  are 
not  considered  to  be  published  merely  by  virtue  of  appearing  in  this  series. 
This  copy  is  for  private  circulation  only  and  may  not  be  further  copied  or 
distributed,  except  for  government  purposes,  if  the  paper  acknowledges  U.  S. 
Government  sponsorship.  References  to  this  vork  should  be  either  to  the 
published  version,  if  any,  or  in  the  form  "private  communication."  For 
information  about  the  ideas  expressed  herein,  contact  the  author  directly. 

For  Information  about  this  series,  contact  Microsystems  Research  Center,  Room 
39-321,  MIT,  Cambridge,  MA  02139;  (617)  253-8138. 
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Abstract 

In  this  paper,  the  presence  of  delay  in  a  job 
shop  is  addressed.  We  show  that  delay  is  an 
important  consideration  in  many  manufactur¬ 
ing  systems  that  are  modeled  as  continuous  flow 
processes.  A  scheduling  policy  for  a  job  shop 
with  delays  is  then  derived  using  theoretical  ar¬ 
guments  and  heuristics. 

1  INTRODUCTION 

It  is  well  known  that  the  optimal  solution  of 
the  job  shop  scheduling  problem  is,  in  general, 
NP-hard  [2],  Except  for  a  few  problems  un¬ 
der  very  specific  conditions,  no  computationally 
tractable  solution  for  optimization  can  be  found. 
Due  to  this  formidable  computational  complex¬ 
ity,  which  necessitates  the  use  of  static,  over¬ 
simplified  models,  traditional  job  shop  schedul¬ 
ing  approaches  have  not  proven  satisfactory  in 
practice. 

The  approach  proposed  in  [1],  which  in  turn 
is  a  natural  extension  of  [3],  makes  use  of  a  hier¬ 
archical  control  structure  to  remedy  these  prob¬ 
lems.  A  high  level  controller,  similar  to  what 
described  in  (3j,  works  at  long  time  scales  and 
deals  only  with  work  stations  (work  centers).  It 
treats  the  production  process  as  a  continuous 
material  flow.  Its  objective  is  to  control  the  flow 
over  a  long  time  horizon  so  that  the  demand  is 
satisfied  as  closely  as  possible  and  inventories 
are  kept  low,  while  keeping  the  system  within 
production  rate  capacity  constraints. 


The  actual  loading  of  individual  parts  into 
machines  is  left  to  low  level  controllers  which 
work  at  shorter  time  scale.  The  low  level  deals 
only  with  single  work  stations  which  have  far 
fewer  machines  than  the  whole  job  shop.  The 
low  level  attempts  to  fulfill  the  production  goal 
determined  by  the  high  level  controller.  In 
tlii»  way,  the  two  level  controller  can  avoid  the 
formidable  computation  requirements  encoun¬ 
tered  in  traditional  approaches.  Further,  it  dy¬ 
namically  adjusts- the  production-to.cope  with 
real-time  events. 

While  the  two-level,  continuous  flow  model 
does  simplify  the  job  shop  scheduling  problem, 
it  comes  with  a  hidden  cost,  namely  that  the  dif¬ 
ferential  equations  representing  the  system  must 
often  include  delay.  To  see  this,  notice  that  any 
work  station  that  typically  processes  many  parts 
at  a  time  (i.e.  where  the  number  of  total  parts  in 
processes  is  much  greater  than  1)  will  have  av¬ 
erage  interarrival  times  that  are  much  less  than 
the  processing  time  for  a  single  part.  For  such  a 
system,  the  time  parts  spend  in  the  system  can¬ 
not  be  ignored  and  thus  delay  must  be  explicitly 
included  in  the  formulation. 

In  this  paper,  which  is  a  summary  of  the  work 
to  appear  in  [8],  we  analyze  the  high  level  con¬ 
troller  for  systems  with  delay.  In  Section  2  we 
look  at  some  examples  of  manufacturing  systems 
with  delay  and  show  that  a  rather  large  class 
of  manufacturing  systems  require  delay  formu¬ 
lations.  In  Section  3  we  then  show  that  a  delay 
system  can  be  approximated  by  a  system  of  first 
order  differential  equations  without  delay.  We 
use  the  results  of  [Cj  and  let  our  approximation 
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Figure  1:  A  single  work  station  with  delay 
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get  arbitrarily  good  to  arrive  at  a  solution  for  the 
optimal  control.  Due  to  the  difficulty  of  com* 
puting  the  optimal  value  function,  we  next  ex¬ 
plore  a  suboptimal  strategy  based  on  quadratic 
approximations  to  the  value  function.  Finally, 
conclusions  are  presented  in  Section  4. 

2  The  Importance  of  Delay 
in  Manufacturing  Sys¬ 
tems 

We  mentioned  that  delay  arises  in  manufac¬ 
turing  systems  that  work  on  many  parts  at 
one  time.  We  will  now  examine  this  phe¬ 
nomenon  more  closely  and  also  try  to  indicate 
in  what  ways  delay  introduces  difficulties  into 
the  scheduling  problem. 

Firstly,  let  us  point  out  that  introducing  de¬ 
lay  does  not  necessarily  complicate  the  control 
problem.  Consider,  for  example,  a  single  work 
station  with  delay  as  shown  in  Fig.  1.  where  x(t) 
is  the  inventory  in  the  buffer,  r  is  the  delay  (pro¬ 
cessing  time),  u[t)  is  the  loading  rate,  which  is 
bounded  and  the  bound  itself  is  a  random  vari¬ 
able  ([3]),  d(t)  is  the  demand  rate,  which  is  as¬ 
sumed  to  be  deterministic  and  known.  The  dy¬ 
namics  of  this  system  can  be  modeled  as 

*  «(* m  (i) 

By  simply  defining  z(t)  *  x(t  +  r)  and  d[t)  * 
d[t  +  r),  both  of  which  can  be  determined  com¬ 
pletely  at  time  t,  we  can  see  this  problem  is  no 
different  than  the  non-delay  problem.  We  sim¬ 
ply  use  z(t  +  r),  rather  than  x(t),  as  the  current 
state  and  solve  the  problem  as  though  there  were 
no  delay. 


Figure  2:  A  two  stage  system 

Unfortunately,  delay  cannot  always  be  han¬ 
dled  so  simply.  For  example,  consider  the  simple 
two  stage  system  depicted  in  Fig.  2. 

The  system  is  described  by 


iiW  “  -«*(*)  (2) 

i2(0  =  u2(t)-d(t)  (3) 

0  <  *i(«)  (4) 

0  <  UiftSaxW  (5) 

0  <  u2(«)  <  o3  (t)  (6) 


Suppose  the  constraints  for  and  u2  depend  on 
some  random  processes  (e.g.  the  machine  state). 
We  must  determine  uj.  and  u2  based  on  the 
present  constraints  yet  the  value  of  the  future 
inventory,  Xj(t),  depends  on  both  the  present 
ux(t)  and  the  future  u2(t),  the  constraints  on 
which  we  do  not  know. 

Another  example  where  delay  makes  the  prob¬ 
lem  more  complex  is  in  the  scheduling  of  a  reen¬ 
trant  job  shop.  A  reentrant  job  shop  is  one 
where  parts  visit  the  same  work  station  several 
times  [7(.  A  simple  reentrant  job  shop  is  shown 
in  Fig.  3. 

New  parts  are  processed  by  the  work  station 
then  go  back  to  the  same  work  station  for  a  sec¬ 
ond  process.  After  the  second  process  is  finished, 
they  leave  the  system.  There  are  buffers  after 
the  first  and  second  processes  whose  levels  are 
denoted  by  xt  and  x2  respectively.  Suppose  the 
processing  time  for  the  second  process  is  negligi¬ 
ble.  We  then  get  the  same  system  equations,  (2) 
and  (3).  The  only  difference  now  is  that  the  con¬ 
straints  on  ui  and  u2  are  also  coupled,  namely, 
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Figure  3:  A  reentrant  job  shop 


Figure  4:  Diagram  of  two  systems 


Oiui(t)  +  02Uj(t)  <  a(t)  for  some  01,02  and 
a.  This  further  complicates  the  control.  Thus, 
a  single  reentrant  work  station  with  delay  also 
cannot  be  trivially  handled. 

In  the  next  section,  we  expand  on  the  ideas 
suggested  by  these  examples  and  define  the  con¬ 
trol  problem  in  exact  terms. 


Let  us  first  define  new  variables  yt(t)  to  ym(i) 
through  the  following  equations. 


£y  x« 

TTi 

TTi 


yi(t)  -  ya(t) 


(8) 


3  Solution  For  Delay  Sys¬ 
tems 

To  demonstrate  our  solution  technique  more 
clearly,  we  first  investigate  the  simple  problem 
described  in  (2)  to  (6).  The  technique,  however, 
is  extendible  to  more  complex  systems. 

The  objective  functional  is 


mm 

»€0(a) 


J  g[xi,x2)dt 


(7) 


here  0(a)  is  a  polyhedron  defined  by  (5)  and  (6) 
and  p(-)  is  some  function  of  Xi  and  Z2.  Without 
delay,  this  is  the  same  formulation  as  in  [3], 

At  time  t,  the  parts  in  the  first  process  that 
were  loaded  between  t  —  r*  and  t  will  contribute 
to  the  future  inventory  and,  therefore,  should 
become  part  of  the  current  state.  Unfortunately, 
the  problem  then  becomes  an  infinite  dimen¬ 
sional  one. 

In  order  to  overcome  this  difficulty  we  approx¬ 
imate  the  past  ui  by  a  finite  dimensional  first 
order  system.  We  then  let  the  approximation 
become  better  and  better  so  that  it  approaches 
the  original  system. 


~Vm(t)  —  ym— l(t)  Vm  (t) 

m 

The  initial  conditions  are  set  to  zero  at  —00 
and  we  assume  that  m(— 00)  =  0.  Eq.  (8)  de¬ 
fines  a  cascade  of  m  first  order  systems  with 
time  constant  Jj.  Its  input  and  output  are 
ux(f)  and  ym(t)  respectively.  As  a  motivation 
for  using  (8),  note  that  its  transfer  function 
is  1/(1  +  sr/m)m  which  yields  the  well  known 
limit  e~,T,  the  transfer  function  of  a  delay  r,  as 
m  — *  00. 

Now  define 


Xi(0  *  ym(t)~«3(t)  (9) 

X-(t)  =  u2(t)-d(t)  (10) 

Combine  (8)-(l0),  we  obtain  a  new  system. 
The  diagrams  of  this  system  or  the  original  sys¬ 
tem  defined  by  (2)  and  (3)  can  be  drawn  as  in 
Fig.  4. 

The  only  difference  between  the  system  de¬ 
fined  by  (2)  and  (3)  and  the  system  defined  by 
(8)-  (10)  is  the  first  box  For  the  first 

system,  it  is  a  delay  element  with  delay  r.  For 
the  second  system,  it  is  a  linear  system  defined 
by  (3).  If  we  can  show  that  for  the  same  Ui,U2 


AtjC 


Figure  5:  Compare  two  integrals 


and  d,  the  output  of  the  first  system  approaches 
the  output  of  the  second  one,  then  we  can  es¬ 
tablish  an  equivalence  between  the  two  systems. 
By  superposition,  it  is  sufficient  to  show  that 
the  integral  of  y m[t)  approaches  the  integral  of 
ati  (t  —  -r)  as  m  goes  to  infinity. 

To  show  this  result,  we  compare  the  two  sys¬ 
tems  shown  in  Fig.  5.  In  Fig.  5,  /Ti(a)  is  the 
system  defined  by  (8)  and  K7(s)  is  a  pure  delay 
of  r.  We  will  prove  that  z^t)  approaches  z2(t) 
uniformly  in  t  as  m  -*  oo.  First  we  need  the 
following  lemma  which  is  similar  to  [6]. 

Lemma  1  If  u(£)  is  differentiable  with  ju(t)|  < 
K  for  all  t  €  (— oo,  +oo),  then 

lim  sup  |lai(t)-a2  (t)|I  =  0 

m  00  »e(-oo,+oo) 


Proof:  face  [8]). 

The  integrals  in  Fig.  5  start  from  —  oo. 
Since  the  initial  conditions  axe  zero  at  —  oo  and 
u(— oo)  equals  zero,  we  can  switch  the  linear  op¬ 
erators  Ki,K7  with  the  integrators,  1/s.  Be¬ 
cause  u(t)  is  bounded,  the  integral  of  u(t)  has  a 
bounded  derivative.  Combining  these  facts  with 
Lemma  1,  we  obtain  the  following  lemma. 

Lemma  2  If  u(t)  €  L x  and  is  bounded ,  then 

lim  sup  ||*i(t)  -z2(t)||  =  0 

m  00  «€(-=, +oo) 


Using  Lemma  2 ,  we  see  that  the  output  of  the 
system  defined  by  (8)-(10)  approaches  the  out¬ 
put  of  the  system  defined  by  (2)  and  (3).  There¬ 
fore,  if  ux  is  optimal  for  the  first  system,  it  will 
also  be  optimal  for  the  second  one. 

We  will  now  consider  the  optimal  control 
for  the  system  defined  by  (8)-(l0).  Define 
X  =  [xi  x2  yi u  =  [ux  u2]'.  This 
system  can  be  written  in  a  compact  form  as 

x  —  As  +  Bu  +  Cd  (ll) 

Using  the  same  approach  as  in  [3],  it  can  be 
shown  that  the  optimal  control  u  for  the  problem 
defined  by  (ll)  and  the  constraints  (4)-(6)  can 
be  obtained  by  solving 

min  V,J*(x, a)Bu 
«eo(a)  v  ' 

Eq.  (12)  can  be  rewritten  as 

.  . dJ *  3J*  3J* 

nun  - - - — u2  +  - — ux 

u€C(a)  dSi  0X2  3y  1 

Where  J*(x,  a)  is  the  optimal  cost  to  go.  Unfor¬ 
tunately,  Jm  remains  unknown  and  is,  even  for 
simple  problems,  difficult  to  compute.  There¬ 
fore,  we  seek  an  approximation  for  J".  Ex¬ 
perience  ([4), [5])  shows  that  satisfactory  results 
can  be  obtained  with  relatively  crude  approx¬ 
imations  for  J*.  The  one  we  will  use  is  in  a 
quadratic  form  with  coefficients  that  are  func¬ 
tions  of  a,  namely, 

J”(x, o)  3  x'/2(a)x+  5(a)x  (14) 

Then 

V, J*(x,  a)  S  R[a)x  +  5(a)  (15) 

Using  (15)  we  can  rewrite  (13)  as 

mbi  \0i{x,  a)ux  +  £3(x,a)u3]  (16) 

«€n(a) 


where 


m  3 

&(*.<*)  =  5Ip<j(a)yj  +  +  />/(«) 


/»  1 


(17) 


Proof:  (see  / 8) '). 


Letting  m  go  to  infinity  we  get 


fiim  [  A Q)u1(t-ff)io+J2 
Jo  y.i 

(18) 

Eq.  (16)  and  (18)  describe  the  sub-optimal  con¬ 
trol  law  for  our  system.  Note  that  instead  of 
a  very  complex  dynamic  program,  the  control 
(production  rates)  is  determined  by  a  linear  pro¬ 
gram  (16).  The  problem  is  further  simplified  due 
to  the  simple  structure  of  fl(a).  This  calculation 
can  easily  be  performed  in  real  time. 

The  terms  in  /?,-  are  easy  to  interpret.  Note 
that  is  a  function  of  x,-,  a  and  the  past  con¬ 
trol  ui.  The  second  and  third  terms  in  pi  are 
identical  to  the  terms  found  in  the  quadratic  ap¬ 
proximation  presented  in  [3j  for  a  non-delay  sys¬ 
tem.  Added  to  this  is  a  convolution  of  the  con¬ 
trol  ux(f)  with  some  weighting  function  A(<r). 
If  a  constant  weighting  is  applied,  the  first  term 
would  be  the  integral  of  «i{t)  from  t  —  r  to  t, 
which  is  the  number  of  the  parts  currently  un¬ 
der  processing.  Other  weighting  functions  are, 
of  course,  possible. 

Further  research  will  be  conducted  to  obtain 
the  correct  form  of  Pi .  Further,  since  a  real  man¬ 
ufacturing  system  is  much  more  complex  than 
the  system  described  here,  more  complex  sys¬ 
tem  models  will  be  investigated  which  will  take 
into  account  factors  such  as  reentrant  process 
and  time  varying  demand.  Finally,  numerical 
computations  and  simulation  experiments  will 
be  used  to  help  develop  solution  techniques. 


4  Conclusion^  f . .  \ 

In  this  paper,  we  examined-^he  effects  of  delay 
in  manufacturing  systems.  We  proposed  a  gen¬ 
eral  model  for  a  network  of  work  stations  that 
includes  delay.  We  then  presented  a  technique 
for  analyzing  delay  systems  by  augmenting  the 
states  to  include  an  approximation  of  the  past 
control.  Using  quadratic  approximations  to  the 
optimal  value  function,  we  show  that  the  control 
takes  a  particularly  simple  form. 
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